William Ogilvie was a Scottish-born scholar and tutor of Lord Edward FitzGerald, and married Edward's mother Emily FitzGerald, Duchess of Leinster after the death of her first husband. Ogilvie was nine years her junior, and was the natural father of her youngest son from her first marriage. A further three children were born to them after their marriage. After the death of the Duchess, Ogilvie spent his last years in the County Down village of Ardglass. Here he spent his latter years rebuilding what was in the 16th and 17th centuries one of the major trading ports in Ireland. He died in 1832 and his remains are interred in the Church of Ireland in Ardglass.